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Abstract 

We consider a group of Bayesian agents who each possess an independent private signal about 
an unknown state of the world. We study the question of efficient learning: in which games 
is private information efficiently disseminated among the agents? In particular, we explore the 
notion of asymptotic learning, which is said to occur when agents learn the state of the world 
with probability that approaches one as the number of agents tends to infinity. 

We show that under general conditions asymptotic learning follows from agreement on pos- 
terior actions or posterior beliefs, regardless of the information exchange dynamics. 

Keywords: Bayesian learning, rational expectations, aggregation of information. 

1 Introduction 

1.1 Overview 

Following Aumann's Agreement Theorem p], the study of the exchange of information between 
Bayesian agents has resulted in broad theoretical insight into the phenomenon of agreement and 
the dynamics that lead to it. However, while questions regarding convergence to common posterior 
beliefs or common posterior actions are now well understood, the correctness or optimality of these 
beliefs/actions are understood only in special cases. We present general results showing "asymptotic 
learning" for agents who are fully Bayesian, and iteratively act or communicate until they converge 
to the same posterior belief/action. 

We consider a group of Bayesian agents who have to make a choice between two alternative 
actions. The agents are initially given informative, independent and identically distributed private 
signals. They then participate in a general game or process, during which they learn from their 
peers. We are not interested in the details of the dynamics of the game, but in what can be said 
under the condition that at its conclusion the agents reach agreement. We consider two cases: in 
the first they agree on posterior beliefs regarding the optimal action, i.e. the posterior probability 
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that the first action is optimal. In the second they merely agree on which action is more likely to 
be optimal. 

For large groups of agents the combined private signals contain enough information to identify 
the optimal action with probability approaching one. It is natural to ask whether the agents learn, 
i.e., whether this information reaches the agents, or whether information cascades may emerge, 
with arbitrarily large groups of agents who make the wrong decision with probability bounded 
away from zero. We show that "asymptotic learning" occurs for a wide variety of models, so that 
as the size of the group grows the agents learn the correct action with probability that approaches 
one. 

Regardless of the game the agents play, we show that if a group of agents participates in 
any game or process which always results in agreement on posterior beliefs, then information is 
aggregated efficiently and asymptotic learning holds. We further show that when private beliefs 
are unbounded then agreement on actions is a sufficient condition for asymptotic learning. 

Many studies describe Bayesian games or dynamics which always result in agreement, and to 
which, therefore, these results apply. For example, consider a group of agents who are members of 
a social network and iteratively reveal their true posterior beliefs to their neighbors. This dynamics 
almost surely leads to common knowledge and therefore agreement on posterior beliefs, as shown 
by Parikh and Krasucki [TTj. Rosenberg, Solan and Vieille |18j show that this still holds when the 
agents are strategic with some discount factor, in any equilibrium. Simpler mechanisms also exist: 
For example, McKelvey and Page [12\ show that agreement on posterior beliefs can be achieved by 
repeated public announcements of certain statistics of the beliefs. Our results apply and establish 
learning in all these cases. 

The synthesis of this work with that of Rosenberg, Solan and Vieille |I8] may be of particular 
interest. They describe (among a number of models they consider) an iterative game involving 
strategic Bayesian agents on a social network who are trying to estimate a binary state of the world 
from initial private signals. They show that when the network is strongly connected then the result 
is convergence to a common posterior belief, in any equilibrium. Our theorem applies to the game 
they describe, for the case of a binary state of the world and conditionally independent private 
signals. 

Feigenbaum et al. [8] and Ostrovsky |16j show efficient aggregation of information in some 
particular market games. Our results imply that when private signals are conditionally independent 
then in any Bayesian market game in which there exist equilibrium prices - i.e., agents reach 
agreement - these prices exactly reflect the information available to society. 

1.2 General framework 

We consider three models which share a common basis: There is a finite number of agents, with 
S E {0, 1} a binary state of the world which the agents are interested in knowing. Each of the two 
possible states of the world occurs with probability one half. 

The agents are initially provided with signals which are informative with respect to S and 
independent, conditioned on S: There are two distributions, ^ fii, such that conditioned on 
S the private signals are independent and distributed as fis- In Section 11.3.11 we slightly depart 
from this framework by weakening the assumption on the private signals from being independent 
to having zero correlation. 

In all models the agents are assumed to be Bayesian and participate in some general game or 
process involving the exchange of information. We are not interested in the actual dynamics, but 
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only in the informational state at the conclusion of the process. 

We define the action of an agent to be "1" if, at the conclusion of the process it considers 
the probability of the event "S* = 1" to be higher than one half, and "0" otherwise. Asymptotic 
learning occurs when the probability that all the agents' actions are equal to the true state of the 
world S tends to one as the number of agents tends to infinity, for a fixed choice of private signal 
distributions and fiQ. 

1.3 Common posterior beliefs 

Aumann's seminal Agreement Theorem [1] considers two agents who, following a general game or 
process, have posterior beliefs regarding some event which are common knowledge. Regardless of 
how this state was reached, the theorem states that their posterior beliefs must be equal. 

Subsequent results by Geanakoplos and Polemarchakis [10] showed that two rational agents, who 
repeatedly share their beliefs regarding the probability of some event, must converge to identical 
opinions and cannot "agree to disagree". This result was later extended to apply to a group of 
agents connected by a social network by Parikh and Krasucki [17], and furthermore to strategic 
agents by Rosenberg, Solan and Vieille [T5]. The spirit of these findings is that strategic Bayesian 
agents who communicate their beliefs eventually reach agreement, under a very wide spectrum of 
dynamics. 

However, only a few results consider the value of the common posterior belief, and these apply to 
particular games and signal distributions. In the case of independent Gaussian signals and myopic 
agents on a social network, DeMarzo et al. [6] showed that information is optimally aggregated, in 
the sense that the agents converge to the beliefs they would have if they had access to all the available 
information. Furthermore, the Bayesian updates in this case are simple and converge rapidly, as 
shown by DeMarzo et al. [6] and Mossel and Tamuz [15] . Other results showing optimal aggregation 
are those of Feigenbaum et al. [8] and Ostrovsky [T6], for very general signal distributions, but 
specific models of dynamic market games. 

The first question we study in this paper is the following: How effectively do agents who reach 
agreement on beliefs aggregate their private information? Note that we follow Aumann [1] in 
considering only the informational state at the conclusion of the game and disregarding the details 
of the process. 

The common posterior belief depends on all the private signals - the different pieces of informa- 
tion that were initially available to the individuals - as well as the dynamics of the interaction. For 
large enough groups, the information contained in all the private signals suffices to determine the 
correct action, except with exponentially low probability (in the number of agents). Is it possible 
that this information is not disseminated to the agents? 

We show that it is impossible to reach agreement on posterior beliefs without learning a great 
deal in the process: in fact, in this case information is optimally aggregated, in the sense that the 
common posterior belief is the same as it would be if all agents observed all the private signals. 
In particular, this means that "asymptotic learning" occurs: as the size of the group tends to 
infinity the probability that the agents' common action will equal the state of the world tends 
(exponentially fast) to one, irrespective of the details of the game. 

We note that while the assumption of independence is critical for this result, it is not imperative 
that all the signals be identical; our proof of this theorem holds, as is, for the case that signals are 
conditionally independent but not identical. 
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1.3.1 Uncorrelated private signals 

The assumption of conditional independence of private signals may be too strong in certain settings. 
However, when it is completely discarded then asymptotic learning may no longer be a consequence 
of agreement, and in fact it may be the case that agents agree while learning nothing at all from 
each other (see example 12.71 below). Hence it may be of interest to explore how this assumption 
can be weakened while preserving asymptotic learning. Specifically, we consider the case that 
private signals are conditionally uncorrelated For example, signals that are pairwise conditionally 
independent (but perhaps otherwise dependent) are uncorrelated. 

We show that in this case too, agreement implies asymptotic learning. In particular, we show 
that if the agents agree on a posterior belief - and therefore on an action - then the action they 
choose is optimal with probability that is inversely proportional to the number of agents n. We 
show in Example 12.81 that this result is tight. 

1.4 Common posterior actions 

We here again consider a binary state of the world, conditionally i.i.d. private signals, and a general 
information exchange process, as in Section fl.Sl However, the agents in this case are not guaranteed 
to learn each others' posterior beliefs (i.e., posterior probabilities that S = 1), but rather their 
posterior actions: recall that the action is "0" if the posterior probability of 5 = 1 is less than half 
and "1" if this probability is greater than half. If this probability equals half then both actions are 
optimal, and we don't make any assumptions about how the agents break the tie. We therefore, in 
fact, speak of common knowledge of an agent's "optimal action set" L, which may equal {0}, {1} 
or {0,1}. 

Common knowledge of actions is in general an insufficient condition for asymptotic learning. 
Indeed, there are examples in which common knowledge of actions is achieved without asymptotic 
learning, typically involving a small group of agents whose opinions dominate those of the remain- 
ing agents. However, these examples do not include "highly opinionated" agents whose initial 
private beliefs may come arbitrarily close to or 1. Indeed, we show that under the condition 
of "unbounded private beliefs"!! asymptotic learning occurs whenever there is common knowledge 
of actions, regardless of the dynamics. That is, the agents' common optimal action set L equals 
{S} with probability that goes to one as the number of agents goes to infinity. This result shares 
the flavor of other results (cf. Smith and S0rensen [20j) that rule out information cascades when 
private beliefs are unbounded. 

This result applies to many models in which, through varied dynamics, agents reach common 
optimal action sets, for the case of the above described structure of private signals. These include 
models studied by Menager [13], Sebenius and Geanakoplos [E] and one of the games studied 
by Rosenberg, Solan and Vieille [18]. In that game, under certain conditions, strategic agents 
converge to the same action in any equilibrium. Thus this result shows that learning is efficient in 
any equilibrium of their game, provided that private signals are conditionally independent. 

Related questions have been studied in particular games. One line of work considers the case 

^The precise condition for is that the log-likehhood ratio of private behefs has zero covariance, conditioned on S. 
We define this more formally in Definition 12.61 below. 

^We define unbounded private beliefs in Definition 12.41 below. Essentially, private beliefs are unbounded when 
private signals inspire beliefs that may be arbitrarily close to both zero and one. Note that in general there is no 
requirement that beliefs are ever actually equal to zero or one. 
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where each Bayesian agent acts only once, after observing the actions of a subset of the other agents. 
In this case "information cascades" may emerge (cf. Banerjee [3], Bikhchandani, Hirshleifer and 
Welch [S] ) : There exist arbitrarily large groups of agents who take the wrong action with probability 
bounded away from zero. Here too a condition for asymptotic learning (i.e., no information cascade) 
is unbounded private beliefs, as Smith and S0rensen [20J show. Note that while their results are 
similar in flavor (unbounded beliefs imply asymptotic learning), they study a particular game in 
which, as they show, agreement on actions is reached, while we consider any such game. 

A second line of work is the one explored by Ellison and Fudenberg [7J and Bala and Goyal [2], 
who each study a particular non-Bayesian game involving social networks. The latter are also 
interested in asymptotic learning (or "complete learning", in their terms), and show some results 
of asymptotic learning and some results of non-learning, depending on various parameters of their 
model. Since their models are not Bayesian they are very different in nature, making it difficult to 
draw comparisons between our results and theirs. 

A paper by Minehart and Scotchmer [T3| studies the same structure of the state of the world and 
private signals. They consider a solution concept they call Rational Expectations Equilibrium, and 
show that when it exists then agents agree on actions, and that when private signals are unbounded 
then the agreed on action is correct with probability that approaches one as the number of agents 
tend to infinity. Despite the superficial similarity, however, their model differs from ours in several 
crucial aspects, and includes what is a strictly weaker result. 

In their model posterior probabilities are factored in terms of the actions of the different players 
(their Eq. 1). This would correspond to a situation where agents in equilibrium have no information 
regarding the others' private signals, except what is inferred from their posterior actions. Although 
this setting is amenable to analysis, for a given distribution of private signals such an equilibrium 
may not always exist, and indeed they note that typically this is the case (their Proposition 2). In 
particular, their model does not describe general games or processes in which agents learn more 
than the "final" posterior action. These include the games described by Rosenberg, Solan and 
Vieille [18] and the model of Menager [13], to both of which our results do apply. 



2 Formal definitions, results and examples 
2.1 Definitions 

Definition 2.1. Agents: We consider a finite set of n agents denoted by V. 

Definition 2.2. State of the worlds and signals: We assume the state of the world is binary 
S S {0, 1} and that the distribution of S is uniform: ¥ [S = 0] = ¥ [S = 1] = 1/2. 

Given a set of agents V as in Definition \2.1\ and a state of the world S G {0,1}, we define 
the private signals of the agents {Wu '■ u € V} € Jl^ as follows. When 5 = 1 (respectively, 
S = 0) then the signals are distributed i.i.d. according to fii (respectively hq), where fii,HQ are two 
distributions over the same probability space (Q, O). We assume throughout that the private signals 
are informative, i.e., fii fiQ. 

We assume that the Radon-Nikodym derivative dfii/d^Q exists for all lo € ft. We denote by z 

the log-likelihood ratio z{uj) = log . We denote = Z(Wu). 

Definition 2.3. Private beliefs: the private belief of agent u is the posterior probability of the 
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event S = 1 given u 's private signal Wu '■ 



Bu = ^[S = l\Wu]. 



Definition 2.4. Bounded and unbounded private beliefs: In the framework of Definition \2.S\ we say 
that the agents have bounded private beliefs if there exists ane > such that P [e < By^ < 1 — e] = 
1. 

Accordingly, private beliefs are unbounded from below when for every e > it holds that 
P [Bu < e] > 0, and unbounded from above when for every e > it holds that P [B^ > 1 — e] > 0. 

Finally, unbounded private beliefs are such that are unbounded from both below and from 
above. 

Note that beliefs can be unbounded even though P = 0] = P [By^ = 1] = 0, i.e., beliefs are 
unbounded even when can come arbitrarily close to {0, 1}, although these values may never actually 
be realized. 

Definition 2.5. Common knowledge of beliefs and actions.' Consider a set of agents with private 
signals, as defined in Definitions \2.1\ and \2.S\ . The private signals may be bounded or unbounded. 

Assume that furthermore each agent u has some additional information, and denote by Tu the 
a-algebra of what is known to agent u. We assume that Tu is a sub a-algebra of a(Wi, . . . Wn), so 
that each agent's additional information is measurable in the aggregation of the private signals. 

Let the posterior belief of agent u be given by X„ = P [S" = l\J-u]. 

Let the posterior optimal action set of agent u, L^, be the set of actions that is more likely, 
conditioned on Tu, to be equal to the state of the world. 



Common knowledge of beliefs is said to occur when is almost surely J-^, measurable for 



Common knowledge of actions is said to occur when L^ is almost surely Tw measurable for 
all u,w G V. 

2.2 Common beliefs model 

In this section we discuss the case of common knowledge of beliefs. Using the definitions above, 
Aumann's Agreement Theorem implies the following: 

Theorem (Aumann). Let V be a set of agents with common knowledge of beliefs (Definition \2.5\) . 
Then there exists a random variable X such that almost surely X^ = X for all u £ V . 

It follows that there exists a common optimal action set L such that almost surely L^ = L for 
all u. Note that the converse of this theorem is trivially true: if all beliefs are almost surely equal 
then they are almost surely common knowledge. 

Our main theorem for this section is the following. 



< {1} 

.{0,1} 



Xu < 1/2 
Xu > 1/2 
Xu = 1/2. 



all u,w £ V . 
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Theorem 1. Let V be a set of n agents with common knowledge of beliefs fDefinition \2. 5\) . so that 
there exists a common posterior belief X such that almost surely X = X^ = P [5 = l\J-u] for all 
ueV. Then 

X = F[S = l\Wi,...,Wn]. 

The extension of this theorem to private signals that are not identically distributed (but still 
conditionally independent) is straightforward; essentially the same proof applies. 

2.2.1 Uncorrelated private signals 

In this subsection we relax the conditional independence assumption on private signals, requiring 
instead that private signals are conditionally uncorrelated. Recall that = jfi^i^u)- 

Definition 2.6. Private signals are conditionally uncorrelated when Cov[Zu, Zy\S] = for all 
u,v G V. 

For example, when private signals are conditionally pairwise independent then they are uncor- 
related. 

Our main theorem here is the following. 

Theorem 2. Let V be a set of n agents with common knowledge of beliefs (Definition \2. so that 
there exists a common posterior belief X such that almost surely X = X^ = ¥[S = l\J-u] for all 
u (z V. Let private signals be uncorrelated conditioned on S, but perhaps otherwise conditionally 
dependent. 

Then there exists a constant D = D{fiQ,fii) depending only on fii and fiQ such that all agents 
take the optimal action with probability at least 1 — AD/{n + D), where n is the number of agents: 

AD 

F[L = {S}] > 1 



n + D 



If we impose no conditions at all on the dependence structure of the private signals, then it may 
be the case nothing at all may be learned, even when posteriors beliefs are common knowledge. 
Consider the following well known example (e.g., [8]). 

Example 2.7. Let the private signals be i.i.d. uniform bits (i.e., P [Wu = 1] = l/2j, and let S 
equal the sum of the private signals, modulo 2. 

Clearly agent u's private belief P [S = l\Wu] equals one half, regardless of Wu- Hence private 
beliefs are common knowledge, without need for any communication. However, the agents' action 
will only equal S w.p. half, independent of the number of agents. 

The following next example shows that the bound of Theorem [2] is asymptotically tight. 

Example 2.8. Let V be the set of agents such that \V\ = n and n is divisible by 4- Let S be 
chosen uniformly at random from {0, 1}. Let U be a subset ofV, chosen uniformly at random, and 
independent of S, from all the subsets of V of size 3n/4. Let S be an additional random variable 
such that 



S 




w.p. p[n) 
w.p. 1 — p{n), 
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where S is independent of U and 




1 - 



n — 1 
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The private signals are: 



S 



ifueU 
otherwise 



Wu = 



1 - s 



The communication protocol consists of all agents revealing their private signals to all other 
agents. 

Now, it is easy to verify that private signals are pairwise-independent, conditioned on S: 



and so in particular private signals are uncorrelated and this example satisfies the conditions of 
Theorem [2j 
Note that 



so that asymptotically the probability that S ^ S is inversely proportional to n. Since the private 
signals are dependent on S only through S, it follows that even though the agents gain complete 
knowledge of the private signals, they still may choose the wrong action with probability propor- 
tional to 1/n. 

Example l2.8l does not exclude the possibility that when signals are uncorrelated then information 
is still optimally aggregated, although this optimum may only reveal S with probability inversely 
proportional to the number of agents. This can be achieved by combining Examples 12.81 and 12.71 

Example 2.9. Let each agents' private signal consist of two bits. The first bits of the agents are 
picked as in Example \2. 7\ while the second bits are pick as in Example \2.8[ 

The communication protocol consists of all agents revealing their second bit to all other agents. 

Here too the agents choose the action S with probability 1 — 1/n. This is despite the fact that 
optimal aggregation of information would result in them choosing S with probability 1. 

2.3 Common actions model 

In this section we discuss the case of common knowledge of actions, as defined above in Defini- 
tion [231 

As shown in Sebenius and Geanakoplos [19] (for finitely supported private signals) and more 
generally in Geanakoplos , common knowledge of optimal action sets implies that optimal actions 
are identical. 

Theorem (Geanakoplos). Consider a set of agents with common knowledge of actions (Defini- 
tion \2. 5|) . Then there exists an L such that almost surely = L for all u gV. 



P [Wu = 1,W.^ = 1\S]=F [Wu = l\S]F [W^ = 1\S] 
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The boundedness of beliefs (Definition I2.4p play an important role in the case of common 
actions. When private beliefs are bounded then common knowledge of optimal action sets does not 
imply asymptotic learning, as shown by the following exampl^. However, when private beliefs are 
unbounded then asymptotic learning occurs, as we show below. 

Example 2.10. Let there be n > 100 agents, and call the first hundred "the Senate". The private 
signal is a bit that is independently equal to S with probability 2/3. At stage one, each senator gains 
knowledge of the private signals of all the other senators. At stage two, all agents gain knowledge 
of this optimal action of the Senate. 

It is easy to convince oneself that after stage one, all senators adopt the same action, which 
depends only on their senatorial signals. Also, it is easy to see that after at stage two, by Bayes' 
Law, the rest of the agents disregard their own private signals and adopt the Senate's optimal 
action set. Hence all the agents' optimal action sets are common knowledge after this stage. 

The probability that the Senate makes a mistake is strictly constant and does not depend on 
the number of agents n. Hence the probability that the agents choose the wrong action does not 
tend to zero as n tends to infinity, even though this action set is common knowledge. 

We show that this cannot be the case when private beliefs are unbounded, in the following 
theorem which is the main result of this section. 

Theorem 3. Let V be a set of n agents with common knowledge of actions (Definition \2. 5]) . so 
that there exists a common posterior actions set L such that almost surely L = L^ for all u £ V . 
Assume that beliefs unbounded from below (Definition \2.4\ ) . 

Then there exists a sequence q{n) = q{n, ^q, fii), depending only fii and ^q, such that q{n) — )• 1 
as n ^ oo, and when 5 = then the agents take action "0" with probability at least q{n), where n 
is the number of agents: 

P[L = {0}|5 = 0] > q{n). 

By the symmetry of the states of the world, an immediate consequence of this theorem is that 
asymptotic learning occurs when L is common knowledge and private signals are unbounded in 
both directions: 

^[L = {S}\>q[n) 
for some q{n) — > 1, when private beliefs are unbounded. 

3 Proofs 

3.1 Common beliefs model 
3.1.1 Preliminaries 

We recall the details of the common beliefs model. S is binary state of the world picked uniformly 
at random. The information available to each agent u, denoted by J-u, includes a private signal 

^This example is reminiscent of Bala and Goyal's [2] royal family graph. 
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Wu, picked from either ni or fiQ, depending on whether S = + oi S = —. Agent u's posterior behef 
is Xu = F[S = l\Tu], and its posterior action is is given by 



f {0} Xu < 1/2 
{1} Xu > 1/2 
[{0,1} Xu = l/2. 



Beliefs are common knowledge: X^ is J-'u measurable for all li; € V. By Aumann's Agreement 
Theorem [1], there exists an X such that X^ = X for all u. Hence there also exists an L such that 
Lu = L for all u. 

Our main result for this model is the following. 

Theorem. [J\Let V be a set of n agents with common knowledge of beliefs (Definition \2.5\) . so that 
there exists a common posterior belief X such that almost surely X = Xu = P [5 = for all 

u € y. Then 

X = ¥[S = l\Wi,...,Wn]. 

Proof. Recall that Z„, agent it's private log-likelihood ratio, is 



Zu = log - — 



1 ^[S = l\Wu] 
log- 



djii 



Denote Z = Z^. Then since the private signals are conditionally independent it follows by 
Bayes' rule that 

¥[S = l\Wi,...,Wn\=logit{Z), (1) 
where logit(2;) = e^/(e^ + e~^). Since 

X = F[S= 1\X] =E[F[S = l\X,Wi,...,Wn]\X] 

then 

X = E[logit(Z)|X], (2) 

since, given the private signals {Wi, . . . , Wn), further conditioning on X (which is a function of the 
private signals) does not change the probability of the event S = 1. 

Our goal is to show that X = F[S = l\Wi, . . . , Wn] ■ We will do this by showing that conditioned 
on X, Z and logit(Z) are linearly independent. It will follow that conditioned on X, Z is constant, 
so that Z = Z[X) and 

X = F[S = l\X] = ¥[S = l\Z{X)] = ¥[S= l\Wi, . . . ,Wn] . 

By the law of total expectation we have that 

E [Zu ■ logit(Z)|X] = E [E [Z,logit(Z)|X, Zu]\X] . 

Note that E [Zulogit{Z)\X, Zu] = Z^ [logit(Z)jX, Zu\ and so we can write 

E {Zu ■ logit(Z)|X] = E [Z„E [logit(Z)|X, Zu]\X] . 
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Since is Fu measurable, and since, by Eq. [2l X = E [logit(Z)|J^u] = E [logit(Z)|X], then X = 
E [logit(Z)|X, Zu] and so it follows that 

E [Zu ■ logit(Z)[X] = E [ZuX\X] = XE [Zu\X] = E [logit(Z)[X] E [ZuX\X] . (3) 

where the last equality is another substitution of Eq. [2j Summing this equation ([3]) over n E 1/ we 
get that 

E[Z-logit(Z)|X] =E[logit(Z)|X]E[Z|X]. (4) 

Now, since logit(Z) is a monotone function of Z, by Chebyshev's sum inequality we have that 

E [Z ■ logit(Z)|X] > E [logit(Z)|X] E [Z\X] (5) 

with equality only if Z (or, equivalently logit(Z)) is constant. Hence Z is constant conditioned on 
X and the proof is concluded. 

□ 

3.1.2 Uncorrelated private signals 

We now turn to prove Theorem [2j We here relax the conditional independence condition on private 
signals and replace it with the weaker condition of uncorrelated private signals (Definition 12. 6p . 

When private signals are uncorrelated then Theorem [2] states that all the agents pick the correct 
action L = {S} with high probability: P [L = {5}] > 1 — -i^^- The constant D here depends on 
how informative the private signals are. We call it the noise to signal ratio of (^i, /Uq), and define 
it as follows: 

Definition 3.1. Let fii, jiQ he two distributions on [Vt, O), such that the Radon- Nikodym derivative 
z{uj) = ^^\^ exists everywhere. Then the noise to signal ratio of the pair {^i, jio) is 

D = 2 VarM.^ + Var.oZ 

(DKLip-illfJ-o) + -Da-l(w1I/"o)) 

Where Dkl{'\\') denotes the KuHback-Leibler divergence 

The reader may object that any of the four quantities involved in the definition of D may 
diverge. We proceed with this section assuming this is not the case, and address this technical 
point below in subsection 13.1.31 

Recall the definition Xu = P [S" = l\Fu\- Since S G {0, 1}, this is equivalent to Xu = E [SIJ^^], 
which in turn makes X„ the minimum variance unbiased estimator (or MVUE, c.f. [3]) of S given 

Xu = argmin Var [M — S] , 

MgJ\,,E[M]=E[5] 

Recalling that there exists a random variable X such that almost surely Xu = X we can likewise 
write X = argmin^gjr^ Var [M — S], for all u . 

We show that for large networks X is indeed a good estimator of 5", in the following sense. 
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Theorem 3.2. Consider the common beliefs model (Definition \2. 5|) with agent set V such that 
\V\ = n and with uncorrelated private signals (Definition \2. Then 

Var\X-S]< ^ 



n + D 

where the constant D = D(/^i,/io) is the noise to signal ratio of (fii, fio). 

Our main result for this model is an easy consequence of this theorem: 

Theorem ([2]). Let V be a set of n agents with common knowledge of beliefs (Definition \2. 5|) . so 
that there exists a common posterior belief X such that almost surely X = X^ = P [S" = l\J^u] for 
all u ^V. Let private signals be uncorrelated conditioned on S, but perhaps otherwise conditionally 
dependent. 

Then there exists a constant D = D(fj,Q,fii) depending only on fii and fiQ such that all agents 
take the optimal action with probability at least 1 — 4D/(n + D), where n is the number of agents: 

AD 

F[L = {S}] > 1 



n + D 



Proof. Since X is the minimum variance unbiased estimator of S given J~U) it is in pa-rticulcir 
unbiased: E [X\ = E [5]. Hence we can strengthen the statement of Theorem 13.21 and in fact write 

E[(X-5)2]<-^. (7) 

By Markov's inequality we have then that 

AD 



\X-S\>\]< 



n + D 

Since L„ = {S} for all u whenever \X — S\ < ^ then the theorem follows. □ 

To prove Theorem 13.21 we shall need a few standard lemmas: 
Lemma 3.3. // /xi 7^ ^0 then Cov [5, Zu] > 0. 

Proof. Let DKL{^\\^) denote the Kullback-Leibler divergence [11] . Then 

Cov [S, Zu] = E [SZu] - E [S] E 

= iE [Zu\S = l]-\&[Zu\S = 0] 

= 3 [Dkl{iJ'i\\i^o) + DKiil^oWfii)] 

The lemma follows from the fact that KL-divergence is zero only for identical distributions and 
positive otherwise. □ 
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Since the private behefs are identically distributed then Gov [S, Zy] is independent of u. 

An equivalent statement to the lemma above is that E [Zu 1 5 = 1] > E [Z„ | = 0] . Since the 
private signals are uncorrelated conditioned on S, we expect that for large n their average will be 
close to either E [Zu\S = 1] if 5 = 1 or E [Zu\S = 0] if S* = 0. Hence we can expect that 

Zu-E[Zu\S = 0] 



Y 



-E 

n ^ 



E[Zu\S = l]-E[Zu\S = 0] 



(8) 



will be a good estimator for S. To prove our theorem we show in lemma \3M that this is indeed the 
case. We will finish the proof by furthermore showing that the agents' limiting estimator X is as 
good as Y. 

Lemma 3.4. Var[y — S] = where D = D{fii,fio)- 

Proof. From the definition of Y it follows that E [Y] =E[S]. Hence 

Yai[Y -S] = ¥[S = 1]E[{Y - Sf\S = l] + ¥[S = 0]E [{Y - Sf\S = O] . 

By the definition of Y this means that 

Varfy-'?1 = 1 Var[E.^n|g=l]+VarE„^.|g = 0] 
^ ^ n2 2(E[Z„|S = 1] -E[Z„[5 = 0])2 



and since the private belief log-likelihood ratios Zu are uncorrelated conditioned on S, we have that 



Var 



s 



Var [Zu \S = s] = nVar [Z„ | = s] 



so that 

Var [y 

where D = D{fj,i,fiQ) is the noise to signal ratio of Definition 13.11 above. □ 

We would next like to bound the variance of Y. By the triangle inequality it follows from 
lemma [33] above and from the fact that Var [S] = 1/4 that Var [Y] < 1/4 + 0{^D/n). We show 
that in fact Var [Y] = 1/4 • (1 + D/n). 

Lemma 3.5. Cov[S,Y] = 1/4 and Var\Y] = \.{l + ^). 

Proof. We first note that 

Gov S]=E [ZuS] -E[S]E 

= \E [Zu\S = l]-\ {\E [Zu\S = 1] + iE [Zu\S = 0]) 
= i(E [Zu\S = l]-E[Zu\S = {)]) 

Since the different Z^s are independent conditioned on S it follow from the definition of Y (Eq. [S]) 
that Gov[5,y] = 1/4. The claim Var [F] = 



^1 + follows by substituting Var \Y — S] 



D/{in), the result of lemma [331 above, into the identity Var [Y - S] = Var [S]+Yar [y]-2Gov [S, Y]. 

□ 
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We are now ready to prove Theorem 13. 2t 

Proof. Recall that Zu is u's private belief and as such is in as is X + bZ^, for any b £ ] 
Therefore, since X = Xu is the minimum variance unbiased estimator of S given J-'^, for all b € 

Var [X -S]< Var [{X + bZu) - S] . 

We therefore have that 

aVar [{X + bZu) - S] 



or that Gov [X, Z„] = Cov[5, Z^]. Since this is true for all n, by the bilinearity of covariance we 
have that 

Gov [X, Y] = Gov [5, Y] . (10) 

Gonsider the set of zero expectation random variables measurable in our measure space which 
have a second moment. This set is a real Hilbert space with Gov [•, •] as its inner product. Hence 
we can decompose (S* — E [S]) (a zero expectation r.v.) to the following sum: 

5-E[5] = a(y-E[y]) + T^s, (n) 
with a G M and = Gov [y - E [y], Ws] = Gov [y, Ws\. It follows that 

Gov [S, Y] = Gov [aY + Ws, Y] = aVar [Y] . (12) 

We can likewise decompose 

x-E[x] = /3(y-E[y]) + Wx, 

with /3 G M and Gov [y, Wx\ = 0. But since Gov [X, Y] = Gov [5, Y] (Eq. HO]) it must be that in 
fact (3 = a and we can write 

X -¥.[X]=a{Y -¥.[Y]) + Wx- (13) 

Since E [X] = E [S\ we can subtract Eq. HUfrom Eq. [I3]and get X - S = Wx - Ws- We will show 
that Var [X — S] is small by showing the both Var \Ws] and Var \Wx] are small. 

Since Gov [y, Ws] = and also Gov [y, Wx] = we can take the variance of Eq. [11] and Eq. [13] 
to arrive at: 

Var [S] = a^Var [Y] + Var [Ws] 
Var [X] = a^Var [Y] + Var [Wx] ■ 

Now, by Eq. ([T2]) we know that a = Gov [5, Y] /Var [y], and lemma [33] states that Gov [S, Y] = 
1/4 and Var [Y] = \{l + Hence 

2,, Gov [5, y] 2 1 1 

a^Var \Y]^ l i j _ 



Var[y] 4 l + D/n 
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and so 



Now Var [S] = 1/4 and Var [X] < 1/4, since X is bounded between and 1. Hence 

Var [Ws] ^ ^ 



4 n + D 



We have then that 



Var [X -S]= Var [Ws - Wx] 

< 2 (Var [Ws] + Var [Wx]) 
D 

< 

~ n + D 



□ 

3.1.3 Note on private signals with infinite second moments 

The proof of Theorem 13.21 above applies when Z has a second moment. We comment here on how 
it may be extended to the case that the second moment of diverges. 

In this case the difficulty that arises is that D and Y are not well defined. To mend this we 
substitute for Zu in the definitions of Y (Eq. [8]) and D (Eq. [6]) and in the proofs that follow. We 
fix M and take Y^^ to equal Z^ when [Zu[ < M and Y^^ = otherwise, choosing M large enough 
so that yj^^ is an informative signal with respect to S; let /ii,M and /io,M be the distributions of 
Y^^ when 5 = 1 and 5 = 0, respectively. Then we choose M that enough so that /ii,Af 7^ /^o,Af • 

Now, Y^ is bounded and therefore has both a first and a second moment, which our proof 
requires. Furthermore, Y^ is measurable by agent u; substituting it for Z^ is tantamount to having 
agent u ignore its private signal when it is too strong. The proofs of the lemmas and the theorem 
remain valid, with a small variation to the definition of the noise to signal ratio D - Theorems [1] 
and 13.21 hold with D = -D(/ii,Af ) Aio,Af)i rather than D(/ii,/xo), which isn't well defined in this case. 

3.2 Common actions model 

We recall the details of the common actions model (Definition 12. 5p . S is binary state of the world 
picked uniformly at random. The information available to each agent u, denoted by Tu, includes a 
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private signal Wu, picked from either fii or fiQ, depending on whether = + or = — . Agent n's 
posterior behef is Xu = f[S= l\Tu], and its posterior optimal action set is Lu is given by 



By virtue of it being a common actions model, J-u further includes Lyj for all w (zV. By Geanako- 
plos [9], there exists an L such that Lu = L for all u. 

Definition 3.6. We denote by Bu the probability of S = 1 given agent u 's private signal: 



We consider here the case of unbounded beliefs (Definition 12. 4p . so that for any e > it holds 
that P [B„ < e] > and P [B„ > 1 - e] > 0. 

Our main result for this model is the following: 

Theorem 3.7 ([3]). Let V be a set of n agents with common knowledge of actions (Definition \2. 5\) . 
so that there exists a common posterior actions set L such that almost surely L = for all u (zV . 
Assume that beliefs unbounded from below (Definition \2.4^ . 

Then there exists a sequence q{n) = q{n, fiQ, fii), depending only fii and fiQ, such that q{n) 1 
as n ^ oo, and when 5 = then the agents take action "0" with probability at least q{n), where n 
is the number of agents: 



This theorem follows trivially from the following theorem which we prove below: 

Theorem 3.8. In the common actions model, fix /ii and /iQ. Consider a sequence of agent sets 
{KilJ^i; with \Vn\ = n. Denote the common optimal action set of the agents in Vn by Ln- Then if 
private signals are unbounded from below then 



We shall need two standard lemmas to prove this theorem. 
Lemma 3.9. P [S" = = 
Proof. Since Bu is a function of Wu then 

F[S=l\Bu = bu] = E [P [5 = l\Wu]\Bu{Wu) = bu] 
= E[Bu\Bu = bu] 



[{0} 

Lu = I {1} 
.{0,1} 



Xu < 1/2 
Xu > 1/2 
Xu = 1/2. 



Bu = F[S = l\Wu]. 



F[L = {0}\S = 0] > q{n). 



lim P[L„ = {0}|5 = 0] = 1. 



□ 



The two following corollary follows trivially from this lemma: 
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Corollary 3.10. F[S = 0|B„ < e] > 1 - e. 

Lemma [3. Ill is a version of Chebyshev's inequality, quantifying the idea that the expectation of 
a random variable Z, conditioned on some event A, cannot be much lower than its unconditional 
expectation when A has high probability. 

Lemma 3.11. Let Z be a real valued random variable with finite variance, and let A be an event. 
Then 



IE [Z] - <E[Z\A]<E [Z] + 



Proof. By Cauchy-Schwarz 



[E [Zl (A)] -E[Z]F [A] [ = |E [(Z - E [Z]) • 1 (A)] \ < ^/Ya^[Z]¥[A]. 

Dividing by F[A] and noting that E[Z1 (A)] /¥ [A] = E[Z\A] we obtain the statement of the 
lemma. □ 

We are now ready to prove Theorem 13. 8[ 

Proof of Theorem \3.8[ For simplicity of notation we write "-L„ = 0" rather than "L„ = {0}" , in 
this proof. 

We would like to show that lim„_!.oo P [Ln = 0\S = 0] = 1. For ease of notation we will denote 
Qn = P [Ln ^ 0\S = 0] and show that lim„_j.oo Qn = 0. 

Pick an arbitrary agent u. Recall that by definition = F[S = l\J-u]- By lemma [3^2] above 
F[S = l\Bu] = Bu, and so 

E [Xu\Bu] =E[F[S = l\Tu]\Bu] = P [5 = 1|5„] = 

Applying Markov's inequality to X^ we have that P [X^ > WBu < e] < 2e, and in particular 
F[Xu>\,S = {)\Bu<e] <2e. 

Since all agents have the same optimal action set the choice of u is immaterial and the 
event "X^ > ^" is, by definition of L„, the same event as "L„ 7^ 0". Hence 

P[L„y^0,5 = 0|5„<e] <2e. 

By application of Bayes' Law we have that 

' [Bu < e] 



F[Bu < e\Ln / 0,5" = 0] < 2e- 



[Ln^o,s = oy 

RecalHng our definition g„ = P [L„ ^ 0\S = 0], we have that P [L„ / 0, S = 0] = P [5 = 0] g„ = ig„ 
so that we can write 

F[B^<e\Ln^O,S = 0]<Ae^^^^^. (14) 

If we denote 

Kn = -y^l{Bu<e) (15) 
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then by averaging Eq. [T3] over all u € F we get that 

E[K„[L„/0,S = 0] <46 ^ ^ (16) 

qn 

We thus bound E [Kn\Ln 7^ 0, 5 = 0] from above. We will show that is small by also bounding 
it from above. 

Applying lemma 13.111 to Kn and the event "L„ 7^ 0" (under the conditional measure 5 = 0), 
this lemma yields that 



E [Kn\Ln ^0,S = 0]>E[Kn\S = 0] 



/Var [Kn\S = 0] 



Since the agents' private signals (and hence their private beliefs) are independent conditioned 
on S = 0, Kn (conditioned on S) is the average of n i.i.d. variables. Hence Var [ir„|S' = 0] = 
n-^Var [1 (B„ <e)\S = 0] and E [Kn\S = 0] = P [S„ < e\S = 0]. Thus we have that 



E [Kn\L,, ^0,S = 0]>F[B^< e\S = 0] - ^-1/2 / Var [1 (i?„ < e) |5 - 0] ^ ^^^^ 

y Qn 

Joining this bound (Eq. [T7|) with the bound from Eq. \TE[ we get that 



, [B„ < ,|5 = 01 - VaMl(B.<^)|5 = 0] ^ |B. < 



or 



2eP [S„ < e] + V^nVar [1 {Bu<e)\S = 0] ,^ ^, 

^" < P[i?.„<6|5 = 0] • 

Here we used the theorem hypothesis that P [B^ < e\S = 0] > 0, or that the signals are unbounded 
from below. 

Taking the limit n ^ 00 we get that 

lim qn < 2e- 



'F[Bu < e\S = 0]' 
which by application of Bayes' law means that 

and since by corollarv 13.101 above we know that P [S" = 0\Bu < e] > 1 — e, then 

lim Qn < 

n— >oo 1 — g 

Since this holds for all e, we have shown that lim„_>oo Qn = 0. 



□ 



18 



The proof above in fact implies a more quantitative bound for g„ in terms of n and the private 
behef distribution: 

Corollary 3.12. 

r 2e 4 1 

Qn < minmax < , ^ — > . (19) 

^ €>o \l-e' n¥[Bu<e\S = 0]j ^ ^ 

Proof. In Eq. [18] above, we consider two case, depending on which of the first or the second term 
in the denominator of the r.h.s. is larger, and using the fact that a + b < 2max{a, b}. 

In the case that 2eP [B^ < e] is the larger term then the same derivation of the proof applies so 
that 

qn < 2-^. 



In the second case we obtain 

2n~^/yqnYar[l (5, < e) |S = 0] 



qn < 



F[Bu<€\S = 0] 

which by squaring and simplifying yields 

4 Yar [1 ( Bu < e) \S = 0] 4 1 - F [Bu < e\S = 0] 4 
a„ < — ■ — ^ — — - = — ■ — —r ^ < — 



n F[Bu<€\S = 0f n P[B„<e|5 = 0] "n P[B„<e|5 = 0]' 

□ 
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